Statistical learning for probability-constrained stochastic optimal control

نویسندگان

چکیده

We investigate Monte Carlo based algorithms for solving stochastic control problems with local probabilistic constraints. Our motivation comes from microgrid management, where the controller tries to optimally dispatch a diesel generator while maintaining low probability of blackouts at each step. The key question we are empirical simulation procedures learning state-dependent admissible set that is specified implicitly through constraint on system state. propose variety relevant statistical tools including logistic regression, Gaussian process quantile regression and support vector machines, which then incorporate into an overall Regression (RMC) framework approximate dynamic programming. results indicate using or estimate admissibility outperforms other options. offer efficient reliable extension RMC probability-constrained control. illustrate our findings two case studies problem.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Mixed Strategy for Constrained Stochastic Optimal Control

Choosing control inputs randomly can result in a reduced expected cost in optimal control problems with stochastic constraints, such as stochastic model predictive control (SMPC). We consider a controller with initial randomization, meaning that the controller randomly chooses from K+1 control sequences at the beginning (called K-randimization). It is known that, for a finite-state, finite-acti...

متن کامل

Optimal probability density function control for NARMAX stochastic systems

This paper presents a new control strategy for a class of non-Gaussian stochastic systems so that the output probability density function (PDF) of the system can be made to follow a desired PDF. The system considered is represented by an Nonlinear AutoRegressive and Moving Average with eXogenous (NARMAX) inputs with input channel time-delay and non-Gaussian noise. Amulti-step-ahead nonlinear cu...

متن کامل

Two approaches to constrained stochastic optimal control problems

In this article, we study and compare two approaches to solving stochastic optimal control problems with an expectation constraint on the final state. The case of a probability constraint is included in this framework. The first approach is based on a dynamic programming principle and the second one uses Lagrange relaxation. These approaches can be used for continuous-time problems; we provide ...

متن کامل

State-Constrained Stochastic Optimal Control Problems via Reachability Approach

This paper deals with a class of stochastic optimal control problems (SOCP) in presence of state-constraints. It is well-known that for such problems the value function is, in general, discontinuous and its characterization by a Hamilton-Jacobi equation requires additional assumptions involving an interplay between the boundary of the set of constraints and the dynamics of the controlled system...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: European Journal of Operational Research

سال: 2021

ISSN: ['1872-6860', '0377-2217']

DOI: https://doi.org/10.1016/j.ejor.2020.08.041